Picture taking reading apparatus

ABSTRACT

An apparatus having an image sensor is provided. An image sensor of the apparatus can include a two dimensional image sensor. A lens assembly can be provided in combination with an image sensor. In one aspect, an apparatus can attempt to decode a decodable symbol representation. In one aspect an apparatus can output a frame of image data.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a divisional of U.S. patent application Ser. No.13/361,034 filed Jan. 30, 2012 entitled “Picture Taking Optical Reader”which is a divisional application of U.S. patent application Ser. No.12/645,221, filed Dec. 22, 2009 entitled “Picture Taking Optical Reader”(now U.S. Patent Publication No. 2001/0140356) which is a divisionalapplication of U.S. patent application Ser. No. 10/842,851, filed May11, 2004 entitled, “Picture Taking Optical Reader” (now U.S. PatentPublication No. 2005/0001035) which claims priority under 35 U.S.C. §119of Provisional Application No. 60/470,016 filed May 12, 2003, entitled“Picture Taking Optical Reader.” The priorities of the aboveapplications are claimed and the disclosure of each of the aboveapplications is incorporated herein by reference in its entirety.

FIELD OF THE INVENTION

This invention relates generally to optical readers and specifically toan image sensor based optical reader.

BACKGROUND OF THE INVENTION

Optical readers tend to fall into one of three classes: wand readers,laser scan engine optical readers, and image sensor based opticalreaders.

Wand readers generally comprise a single light source and singlephotodetector housed in a pen shaped housing. A user drags the wandreader across a decodable symbol (e.g., a bar code) and a signal isgenerated representative of the bar space pattern of the bar code.

Laser scan engine based optical readers comprise a laser diode assemblygenerating a laser light beam, a moving mirror for sweeping the laserlight beam across a decodable symbol and a signal is generatedcorresponding to the decodable symbol.

Image sensor based optical readers comprise multi-element image sensorssuch as CID, CCD, and CMOS image sensors and an imaging optic forfocusing an image onto the image sensor. In operation of an image sensorbased optical reader, an image of a decodable symbol is focused on animage sensor, and a signal is generated corresponding to the signal.

Because of numerous advances provided by image sensor based opticalreaders, users of laser scanner engine based optical readers have beenswitching in increasing numbers to image sensor based optical readers.Image sensor based optical readers are more durable and offer additionalfeatures relative to laser scan engine based bar code readers. Onefunction which has been incorporated into image sensor based opticalreaders is a picture taking function. Optical readers have beendeveloped which can both take pictures and decode decodable symbolsrepresented in captured image data.

U.S. Pat. No. 5,392,447 describes a hand held image sensor based opticalreader having a “Photo Mode” and a “Text Mode” In the “Photo Mode,”images are captured and subjected to image compression. In a “Text Mode”decodable symbols are subjected to decoding.

U.S. Pat. No. 6,298,176, issued Oct. 2, 2001, entitled“Symbol-Controlled Image Data Reading System” describes an opticalreader, which determines an image data-reading region from an imagereading instruction symbol within an image and then reads image datafrom the image data-reading region.

In spite of the advances such as those embodied in the described priorart, it would be useful to even further advance operationalfunctionality of picture taking optical reader.

SUMMARY OF THE INVENTION

An apparatus having an image sensor is provided. An image sensor of theapparatus can include a two dimensional image sensor. A lens assemblycan be provided in combination with an image sensor. In one aspect, anapparatus can attempt to decode a decodable symbol representation. Inone aspect an apparatus can output a frame of image data.

These and other details, advantages, and benefits of the presentinvention will become apparent from the detailed description of thepreferred embodiment and the associated drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

For a further understanding of these and objects of the invention,reference will be made to the following detailed description of theinvention which is to be read in connection with the accompanyingdrawing, wherein:

FIG. 1 a depicts a reader in use in an operating environment accordingto the invention;

FIG. 1 b-1 j shows various optical reader form factors according to theinvention;

FIGS. 3 a-3 d show various uses of an imaging module;

FIGS. 3 e and 3 f show a graphical user interfaces which may be utilizedin the selection of an operating mode;

FIG. 4 a is a block diagram of an electrical circuit according to theinvention;

FIGS. 5 a-5 d show various timing diagrams illustrating possibleembodiments of a linear decode mode according to the invention;

FIGS. 6 a-6 e are flow diagrams illustrating various operating modesaccording to the invention;

FIGS. 6 f and 6 g are histograms corresponding to captured frames ofimage data captured according to the invention;

FIG. 7 illustrates an optical reader network according to the invention.

DETAILED DESCRIPTION OF THE INVENTION

An optical reader, according to the invention, is decoptied in use inFIG. 1. In a first “decode mode” reader 10 is utilized to decode a barcode 1010 such as a bar code on a package 1012. In a “picture taking”mode, reader 10 is utilized to take a picture of package 1020 carryingbar code 1010, or a storage container, or a trailer box 1030 or asignature or a face. In an automatic imaging mode, reader 10 captures animage, classifies the image, and processes the image in a manner thatdepends on the image classification.

Housings for optical readers in which the invention can be employed areshown in FIG. 2. In FIG. 1 b, a gun style optical reader is shown asdescribed in co-pending application Ser. No. 10/339,275, filed Jan. 9,2003, entitled “Housing For An Optical Reader,” incorporated byreference. An imaging module (not shown) is incorporated in the readerhousing 11. In FIG. 1 c, a gun style reader 10 is shown having anintegrated keyboard 13 k and display 13 d. In FIGS. 1 d, 1 e and 1 f, aportable data terminal (PDT) style reader is shown having a keyboard 13k and a display 13 d. In FIG. 1 f, an embodiment is shown whereindisplay 13 d includes an associated touch screen overlay and whichfurther includes a stylus for entering signature information. In FIG. 1g, a cellular phone is shown which has a display 13 d and keyboard 13 kand which incorporates an imaging module 500. In the embodiment of FIG.1 h, a reader 10 comprises a portable data terminal (PDA). In theembodiment of FIG. 1 j, reader 10 is in the form of a transactionterminal including card reader 240, as is described in U.S. patentapplication Ser. No. 10/339,444, filed Jan. 9, 2003, entitled,“Transaction Terminal Comprising Imaging Module,” incorporated byreference. Numerous other form factors are possible. For example, inU.S. application Ser. No. 10/092,789, filed Mar. 7, 2002, entitled“Optical Reader For Imaging Module,” incorporated by reference, a penstyle optical reader is shown. In U.S. application Ser. No. 09/432,282,filed Nov. 2, 1999, entitled “Indicia Sensor System For Optical Reader,”incorporated by reference, a reader is shown which rests on a “scanstand.”

An imaging module 50 which may be incorporated into a reader housing toform an optical reader is described with reference to FIGS. 3 a-3 d.Imaging module 50 may be an IT 4000 imaging module of the type availablefrom Hand Held Products, Inc. of Skaneateles Falls, N.Y. IT4000 imagingmodules available from Hand Held Products, Inc. are available withassociated decode circuits which may be actuated to decode a decodableindicia, such as bar code indicia, within a captured image. Imagingmodule 50 can be at IT4200 imaging module with an associated decode-outcircuit, also available from Hand Held Products, Inc. Imaging module 50includes a support 80 having a containment 81 containing image sensor 32incorporated on chip 182, and a retainer section 82 retaining a lensassembly 40 provided by a lens barrel. Lens assembly 40 includes a lensor lenses which focus images from a substrate (as seen in FIG. 3 b) ontoimage sensor 32. In one embodiment, lens assembly 40 is configured sothat module 50 has a fixed best focus receive distance of less than twofeet (e.g., 3 inches, 5 inches, 7 inches, 15 inches). Configuring lensassembly 40 so that module 50 has a best focus receive distance of lessthan two feet allows module 50 to capture high resolution images atshort range, from which decodable indicia can readily be decoded. Module5 can also be configured so that module 50 has a best focus distance ofseveral feet such as 5 feet or more as is described in U.S. applicationSer. No. 10/252,484, filed Sep. 23, 2002, entitled “Long Range OpticalReader,” incorporated by reference. Module 50 can also include anadjustable lens assembly for providing an adjustable best focus receivedistance.

Referring to further aspects of module 50, a first circuit board 14 acarrying image sensor chip 182 and aiming LEDs 18 is mounted to aback-end of support 80 while a front circuit board 14 b carryingillumination LEDs 16 is mounted to a front end of support 80. An opticalplate 26 carrying aiming and illumination optics is disposed forward ofsecond circuit board 14 b. Supporting the various component of imagingmodule 50 is a plurality of conductive support posts 84. As shown inFIG. 3 d, support 80 can include integrated mounting wings 80 w aidingin the mounting of module 50 within module 10. Imaging module 50 isfully assembled into a form substantially shown in FIGS. 3 a and 3 b,prior to being installed in reader housing 11. Further aspects of module50 and variations thereof are described in U.S. patent application Ser.No. 10/092,789, filed Mar. 7, 2002, entitled “Optical Reader For ImagingModule,” incorporated herein by reference.

Referring to FIG. 3 b, illumination LEDs 16 together with illuminationoptics including diffusers 27, project an illumination pattern 90 onto asubstrate s. Illumination pattern 1216 at normal working distancessubstantially corresponds to a field of view of imaging module 50.Aiming LEDs 18 together with aiming optics 43, 25 project an aimingpattern 1218 onto a substrate. Aiming pattern 1218 aids in the alignmentof imaging module 50 relative to a target. If reader 10 is moved so thataiming pattern 1218 is located on a target indicia 1010 such as the barcode shown in FIG. 3 b, there is strong assurance that target indicia 94is within a field of view of imaging module 50.

In FIG. 4 a, a block diagram of an optical reader electrical circuit isshown having a multi-functional processor IC chip 180 including anintegrated frame grabber block 148. Electrical circuit 100 shown in FIG.4 a can be utilized for control of a single 2D imaging module opticalreader as is shown for example in U.S. Ser. No. 09/954,081, filed Sep.17, 2001, entitled “Imaging Device Having Indicia-Controlled ImageParsing Mode,” which is hereby incorporated herein by reference in itsentirety.

In the specific embodiment of FIG. 2 a, electrical circuit 100 includesa control circuit 140 comprising CPU 141, system RAM 142 and system ROM143 and frame grabber block 148. Electrical circuit 100 further includesan image sensor 32 typically provided by a photosensitive array and anillumination block 160 having illumination LEDs 16 and aiming LEDs 18 asshown in the physical form view of FIGS. 3 a-3 c. Image sensor 32 ofFIG. 2 a is shown as being provided by a 2D photo diode array. If a 1Dimage sensor replaces image sensor 32, then aiming LEDs 18 andillumination LEDs 16 may be constituted by one set of LEDs. In theembodiment shown, image sensor 32 is incorporated in an image sensor ICchip 182 which typically further includes an image sensor electricalcircuit block 134. Image sensor electrical block 134 includes controlcircuit 135 for controlling image sensor 32, an A/D conversion circuit136, for converting analog signals received from image sensor 32 intodigital form and integrated clock 137 sometimes referred to as anoscillator.

In the embodiment shown in FIG. 4 a, CPU 141 and frame grabber block 148are incorporated in a multi-functional IC chip 180 which in addition toincluding CPU 141 includes numerous other integrated hardwarecomponents. Namely, multifunctional IC chip 180 may include a displaycontrol block 106, several general purpose I/O ports 116, severalinterface blocks such as a USB circuit block 107 and a UART block 108for facilitating RS 232 communications, a UART block 109 forfacilitating infra-red communications (including communication accordingto standards promulgated by the INFRARED DATA ASSOCIATION₇ (IrDA₇), atrade association for defining infrared standards), and a pulse widthmodulation (PWM) output block 110. Multi-functional processor IC chip180 can also have other interfaces such as a PCMCIA interface 111, acompact flash interface 112, and a multimedia interface 113. If reader10 includes a display 13 d, display 13 d may be in communication withchip 180 via display interface 106. Trigger 13 t and keypad 13 k may bein communication with chip 180 via general purpose I/O interface 116.Physical form views of readers having displays and keyboards are shownfor example in U.S. patent application Ser. No. 10/137,484, filed May 2,2002, entitled “Optical Reader Comprising Keyboard,” which is herebyincorporated herein by reference in its entirety. Multi-functionalprocessor IC chip 180 may be one of an available type of multifunctionalIC processor chips which are presently available such as a DragonballMX1 IC processor chip or a Dragonball MXL IC processor chip availablefrom Motorola, a DSC IC chip of the type available from TexasInstruments, an O-Map IC chip of the type available from TexasInstruments, or a multifunctional IC processor chip of a variety knownas Clarity SOC's (e.g., system on a chip) available from Sound Vision,Inc.

In one embodiment, multi-functional processor IC chip 180 comprisescomponents that provide at least the functions provided by a CPU 140,system RAM 142 and system ROM 143. In some embodiments, it isadvantageous that microprocessor-based decoder module 180 comprises anintegrated circuit device having integrated therein a microprocessor, ananalog-to-digital converter, a digital-to-analog converter, a directmemory access (DMA) channel, a bi-directional communication line forcommunication with a sensor such as either or both of line 151 and 152,and a channel for data receipt from a sensor, such as data line 159 thatbrings data to frame grabber 148. The microprocessor-based IC chip 180can comprise semiconductor materials, optical materials, and photonicband gap materials. In some embodiments, it is advantageous that themulti-functional processor IC Chip 180 further comprise I/O 116 suitableto accept user input (for example from a keyboard 13 k), interfacecapability for “flash” memory devices such as “Multimedia” (MMC), “SmartMedia,” “Compact Flash,” and “Memory Stick.” Other features that may beused to advantage include pulse width modulators (PWMs), serialcommunication channels (e.g., UARTs, SPIs, and USBs), display driversand controllers such as for an LCD, wireless communication capabilitysuch as Bluetooth and 802.11(a), (b), and (g)-compatibletransmitter/receivers, sequence control modules such as timer banks,sensor controllers, audio generators, audio coder/decoders (“codecs”),speech synthesizers, and speech recognition hardware and/or software.

Frame grabber block 148 of IC chip 180 replaces the function of a framegrabbing field programmable gate array (FPGA) as discussed in commonlyassigned U.S. patent application Ser. No. 09/954,081, filed Sep. 17,2001, entitled “Imaging Device Having Indicia-Controlled Image ParsingMode,” and U.S. patent application Ser. No. 09/904,697, filed Jul. 13,2001, entitled “An Optical Reader Having a Color Imager,” both of whichare hereby incorporated herein by reference in their entirety. Moreparticularly, frame grabber block 148 is specifically adapted collectionof hardware elements programmed to carry out, at video rates or higher,the process of receiving digitized image data from image sensor chip 182and writing digitized image data to system RAM 142 which in theembodiment shown is provided on a discreet IC chip. Frame grabber block148 includes hardware elements preconfigured to facilitate image framecapture. Frame grabber block 148 can be programmed by a user to captureimages according to a user's system design requirements. Programmingoptions for programming frame grabber block 148 include options enablingblock 148 to be customized to facilitate frame capture that varies inaccordance with image sensor characteristics such as image sensorresolution, clockout rating, and fabrication technology (e.g., CCD,CMOS, CID), dimension (1D or 2D), tonality (from 1 to N-bits), color(monochrome or color), biometric features, such as fingerprints, retinalpatterns, facial features, and one- and two-dimensional patterns thatcan provide information, such as chromatography patterns andelectrophoretic patterns of mixtures of substances, including substancessuch as biological samples comprising DNA. A decoder board adapted tooperate in a manner dependent on sensor attached thereto is described inU.S. patent application Ser. No. 10/339,439, filed Jan. 9, 2003,entitled, “Decoder Board For An Optical Reader Utilizing A Plurality OfImaging Formats,” incorporated by reference.

Aspects of the operation of circuit 100 when circuit 100 captures imagedata into RAM 140 are now described. Circuit 100 can perform a cycle ofreceiving a frame of image data, performing internal programmingfunctions, and decoding the frame of image data in a time period of lessthan or equal to a second. In a more preferred embodiment, the circuit100 performs the cycle in a time period of less than or equal to 1/30 ofa second. It is expected that in a still more preferred embodiment, thetime period can be less than or equal to 1/270 of a second. When trigger13 t is pulled, CPU 141, under the operation of a program stored insystem ROM 143, writes an image capture enable signal to image sensorchip 182 via communication line 151. Line 151, like the remainder ofcommunication lines described herein represents one or more physicalcommunication lines. In the embodiment shown, wherein image sensor chip182 is of a type available from IC Media Corp., I²C interface 115 ofchip 180 is utilized to facilitate communication with chip 182 (ifanother image sensor chip is selected another type of interface e.g.,interface 116 may be utilized). Other types of signals may be sent overline 151 during the course of image capture. Line 151 may carry, forexample, timing initialization, gain setting and exposure settingsignals.

When control block 135 of image sensor chip 182 receives an imagecapture enable instruction, control block 135 sends various signals toframe grabber block 148. Image sensor control block 135 typically sendsvarious types of synchronization signals to frame grabber block 148during the course of capturing frames of image data. In particular,control block 135 may send to frame grabber block 148 “start of framesignals” which inform frame grabber block 148 that chip 182 is ready totransmit a new frame of image data, “data valid window” signals whichindicate periods in which a row of image data is valid, and “dataacquisition clock” signals as established by clock 137 controlling thetiming of image data capture operations. In the embodiment described,line 152 represents three physical communication lines, each carryingone of the above types of signals. In an alternative embodiment,vertical and horizontal synchronization signals are processed by framegrabber 148 to internally generate a data valid window signal. Framegrabber block 148 appropriately responds to the respectivesynchronization signals, by establishing buffer memory locations withinintegrated RAM 149 of block 148 for temporary storage of the image datareceived from image sensor chip 182 over data line 159. At any timeduring the capture of a frame of image data into system RAM 142, bufferRAM 149 of frame grabber block 148 may store a partial (e.g., about 0.1to 0.8) or a full line of image data.

Referring to further aspects of electrical circuit 100, circuit 100includes a system bus 150. Bus 150 may be in communication with CPU 141via a memory interface such as EIM interface 117 of IC chip 180. SystemRAM 142 and system ROM 143 are also connected to bus 150 and incommunication with CPU 141 via bus 150. In the embodiment shown, RAM 142and ROM 143 are provided by discreet IC chips. System RAM 142 and systemROM 143 could also be incorporated into processor chip 180.

In addition to having system RAM 142, sometimes referred to as “working”RAM, electrical circuit 100 may include one or more long-term storagedevices. Electrical circuit 100 can include for example a “flash” memorydevice 120. Several standardized formats are available for such flashmemory devices including: “Multimedia” (MMC), “Smart Media,” “CompactFlash,” and “Memory Stick.” Flash memory devices are convenientlyavailable in card structures which can be interfaced to CPU 141 via anappropriate “slot” electro mechanical interface in communication with ICchip 180. Flash memory devices are particularly useful when reader 5must archive numerous frames of image data. Electrical circuit 100 canalso include other types of long term storage such as a hard drive whichmay be interfaced to bus 150 or to an appropriate I/O interface ofprocessor IC chip 180.

In a further aspect of electrical circuit 100, control circuit 140 isconfigured to control the turning “OFF” and turning “ON” of LEDs 16, 18of illumination block 160. Control circuit 140 preferably controlsillumination block 160 in a manner that is coordinated with thecapturing of the frames of image data. Illumination LEDs 16 aretypically “ON” during at least a portion of frame capture periods.Configuring circuit 140 so that LEDs 16, 18 have “OFF” periodssignificantly reduces the power consumption of circuit 100.

In a further aspect of the electrical circuit 100, electrical circuit100 can be configured so that PWM output interface 114 of IC chip 180controls illumination LEDs of an imaging module such as illuminationLEDs 16 of module 10-1 or aiming/illumination LEDs 18 of module 10-2.

In one embodiment, illumination block 160 is in communication with PWMoutput interface 114 and configured in such manner that LEDs 16 areturned “ON” at a leading edge of PWM pulses output at PWM interface 114,and are turned “OFF” at falling edges of PWM pulses output at PWMinterface 114. PWM interface 114 should be configured so that severalpulses are generated and sent over communication line 153 i during thetime that a single row of pixels of image data are exposed to lightprior to clocking out of pixel values corresponding to that row. Thus,illumination LEDs 16 would be turned “ON” and “OFF” several times duringthe exposure period for exposing a row of pixels to light. Further, thenumber of pulses output by PWM output 114 during the time that a singlerow of pixels are exposed should not vary substantially from row to row.The pixel clock signal received at frame grabber block 148 of IC chip180 can be utilized to generate the PWM output. It can be seen,therefore, that multifunctional IC chip 180 including frame grabberblock 148 and PWM output 114 greatly simplifies the task of developingPWM signals for use in controlling illumination LEDs 16 of module 10.

In another embodiment, PWM output 114 and illumination block 160 areconfigured so that PWM output 114 controls the intensity ofillumination, not the on time/off time of illumination. Illumination LEDblock 160 in such an embodiment can include a power supply circuit whichis interfaced to PWM output 114 such that the PWM signal output at PWMoutput 114 varies the voltage or current supplied to LEDs 16.

In a further aspect of electrical circuit 100, aiming LEDs 18 of circuit100 can be controlled by a signal transmitted by a general purpose I/Oport 116 of IC chip 180 over communication line 153 a. Multifunctionalprocessor IC chip 180 can be programmed so that an aiming LED controlsignal is caused to change to an “ON” state when frame grabber block 148completes the process of capturing a complete frame of image data. Framegrabber block 148 may be configured to generate an “end of acquisition”or “end of frame” signal when frame grabber block 148 completes theprocess of capturing a complete frame of image data into RAM 142. WhenCPU 141 receives an “end of acquisition” signal, CPU 141 controls I/Oport 116 to change the state of LED control signal 168. Control circuit140 may also change the state of LED control signal 168 when generatinga start of frame signal. Control circuit 140 may execute a delay priorto changing the state of signal 168. Control circuit 140 is programmedso that LED control signal 168 remains in an “ON” state known to besufficiently short duration so as not to cause actuation of an aimingLED 18 during a succeeding frame exposure period. Configured in themanner described, aiming LEDs 18 are selectively pulsed “ON” for a shortduration during intermediate successive frame exposure periods. Controlcircuit 140 in one mode of operation selectively turns illumination LEDs16 “ON” during exposure periods and “OFF” intermediate exposure periods,and conversely turns aiming LEDs 18 “ON” intermediate frame exposureperiods and “OFF” during exposure periods. To the user, given the framerate, substrate “s”, (FIG. 3 b) appears to simultaneously have projectedthereon aiming pattern 1218 and illumination pattern 1216 as indicatedby FIG. 3 b, though in an instant of time only one or the other of thepatterns 1216, 1218 is actually present.

While aiming LEDs 18 may be turned “OFF” during frame exposure periodsfor energy conservation purposes and for purposes of more uniformlyilluminating, a substrate “s”, the inventors developed a mode ofoperation in which it is beneficial to turn aiming LEDs “ON” during aframe exposure period.

Control circuit 140 may be configured to operate in a “linear decode”mode of operation in which control circuit 140 is optimized for reading1 dimensional bar codes (such as UPC/EAN, Code 39, Code 128, UPC, ITF,LED 1316). One example of a linear decode mode of operation is describedwith reference to FIG. 5 a including time line 1400 in which aiming LEDcontrol signal 1318 and illumination LED 1616 signal are plotted againstexposure periods EXP_(N), EXP_(N+1), EXP_(N+2). In the linear decodemode described with reference to FIG. 5 a, control circuit 140 turnsaiming LEDs “ON” during frame exposure periods EXP_(N), EXP_(N+1),EXP_(N+2) and maintains illumination LEDs “OFF” throughout the time thatcontrol circuit 140 operates according to the linear decode mode. Thus,as shown in FIG. 5 a, an operator of a reader 10 in which module 50 isincorporated will observe aiming line 1218 without there being anillumination pattern 1216 projected on a target substrate. Maintainingillumination LEDs 16 “OFF” during the linear decode mode is useful for avariety of reasons. Maintaining illumination LEDs “OFF” during a lineardecode mode conserves power. Maintaining illumination LEDs “OFF” duringa linear decode mode also enhances the attention with which a userfocuses on aiming pattern 1218. Turning “ON” aiming LEDs 18 increasesthe signal strength of image signals corresponding to pixel locationsrepresenting an area illuminated by pattern 1218, and aids a user inaligning a reader with a symbol to be read.

Control circuit 140 and module 50 may be configured so that in a lineardecode mode, control circuit 140 preferentially processes image datacorresponding to an area of a target substrate illuminated by aimingpattern 1218. Control circuit 140 can preferentially process image datawithin an area corresponding to aiming pattern 1218 by operating in a“partial frame mode” as described in U.S. patent application Ser. No.09/766,922, filed Jan. 22, 2001, entitled “Optical Reader Having ReducedParameter Determination Delay,” incorporated by reference. U.S. patentapplication Ser. No. 09/766,806, filed Jan. 22, 2001, entitled “OpticalReader Having Partial Frame Operating Mode,” also incorporated byreference. Control circuit 140 can also preferentially process imagedata corresponding to an area illuminated by aiming pattern 1218 bycapturing a full frame of image data and then commencing a decodeattempt by reading a line of pixel valves corresponding to an area of atarget expected to be illuminated by aiming pattern 1218. The readingout of a line of image data during a 1D symbology decode attempt issometimes referred to by skilled artisans as “launching a scan line.”

Another embodiment of a linear decode mode is illustrated with referenceto FIG. 5 b. In the linear decode mode depicted of FIG. 5 b, aiming LEDs18 are “ON” during exposure periods along with illumination LEDs 16. Theembodiment of FIG. 5 b in which both LEDs 16 and LEDs 18 are “ON” duringan exposure period is advantageous at least for the reason that itprovides for a capture of a high quality two-dimensional image. The highquality two-dimensional image can be processed (e.g., for 1D decoding,2D decoding, OCR) should a one-dimensional symbology decode attemptfail. It will be understood that any period as described herein can becharacterized by a rapid turning “ON” and “OFF” of LEDs 16 or 18 duringan exposure period, as is suggested by high-speed pulse segments 1516,1518.

In the examples of FIGS. 5 a and 5 b, there is a delay between frameexposure periods EXP_(N), EXP_(N+1), EXP_(N+2). An example of a lineardecode mode implemented in a reader having overlapping frame exposureperiods is explained with reference to FIG. 5 c. Overlapping frameexposed periods are common when certain types of image sensors are used,e.g., CMOS and CID image sensors. In the embodiment described withreference to signal-time plots 1520, 1530 of FIG. 5 c, aiming LEDs 18are pulsed “ON” during exposure periods and illumination LEDs 16 aremaintained “OFF” for the entire time the reader operates in the lineardecode mode. Control circuit 140 and module 50 can be configured so thataiming LED control signal 1318 is selectively pulsed “ON” during thetime that lines of pixels corresponding to area 1218 illuminated by LEDs18 are being exposed. Signal-time plots 1550, 1560 of FIG. 5 cillustrate possible operation of a reader having overlapping frameexposure periods in a “normal” mode of operation. Signal-time plot 1550illustrates control of aiming LEDs 18 in a “normal” mode. Signal-timeplot 1560 illustrates control of illumination LEDs 16 in a “normal”mode. In a “normal mode” of a reader having an overlapping frameexposure period, illumination LEDs 16 may be “ON” during course of timein which control circuit 140 captures frame of image data (LEDs 16 mayactually be “flickered” as indicated by pulses 1516, 1516, FIG. 5 b).Control circuit 140, however, selectively turns aiming LEDs 18 “ON” and“OFF” while operating in a “normal” mode. Specifically, while operatingin a “normal” mode, control circuit 140 may selectively turn aiming LEDs18 “OFF” during times that it is expected that middle rows of imagesensor 32 are being exposed so that light from LEDs 18 (projected todefine aiming pattern 1218) does not affect image signals generated bymiddle row pixels of image sensor 32. Because in accordance withsignal-time plot 1550, LEDs 18 are “ON” for a substantial portion of aframe capture period, pattern 1218 appears to be always projected to auser. It will be appreciated that selection of a single line horizontalaiming pattern 1218 (as opposed to a two dimensional pattern) inconnection with an image sensor reader having overlapping frame exposureperiods and line by line frame capture simplifies the task ofcontrolling aiming LEDs 18 to project a visible pattern 1218 withoutlight from the LEDs 18 affecting image signals generated by image sensor32.

For comparison, a control circuit 140 operating according to a normaldecode mode in which the control circuit 140 is optimized for decoding asymbology of an unknown type (1D or 2D) is described with reference toFIG. 5 d. In the embodiment described with reference to FIG. 5 d,illumination LEDs 16 are selectively turned “ON” during exposure periodsEXP_(N), EXP_(N+1), EXP_(N+2), while aiming LEDs 18 are selectivelyturned “ON” intermediate of the exposure periods EXP_(N), EXP_(N+1),EXP_(N+2). As alluded previously, illumination LEDs 16 and aiming LEDs18 can be repeatedly pulsed “ON” and “OFF”. Thus, referring to FIG. 5 billumination LEDs 16 can be rapidly pulsed “ON” and “OFF” during a frameexposure period, EXP_(N), EXP_(N+1) as suggested by high-speed controlpulses 1516. Likewise, aiming LEDs 18 can be rapidly pulsed “ON” and“OFF”, as is suggested by high speed control pulses 1518 as shown in thetiming diagram 401 of FIG. 5 b.

Reader 10 can be configured to be driven into a linear decode mode byselection of a menu-displayed icon 1701 as shown in FIG. 3 e. The icon1701 can be selected by “pointing and clicking” using a mouse,trackball, joystick or other pointer to move arrow 1702. Icon 1701 canbe selected by applying pressure to icon 1701 if display 13 is a touchscreen display having an associated touch screen overlay. Reader 10 canbe configured to be driven into a linear decode mode with use of anothermenu interface. For example, reader 10 can be configured to commenceoperation in a linear decode mode on the selection of an appropriate keyof a keyboard 13 k. Reader 10 can also be driven into the linear decodemode by reading a reprogramming “menu symbol” as described in U.S. Pat.No. 5,929,418, issued Jul. 27, 1999, entitled, “Optical Reader HavingImproved Menuing Features,” incorporated by reference. The selection ofthe linear decode mode may also be made remotely by input of a commandinto a nonintegrated host computer (e.g., a GUI or keyboard of a host200, 1802, 1824, 1834, as shown in FIG. 7).

In one embodiment of a linear decode mode, the linear decode mode is notceased until a user manually selects another operating mode. In anotherembodiment, reader 10 is configured on selection of the linear decodeoperating mode to operate in a linear decode mode, and thenautomatically switch to a normal decode mode of operation if a decodeattempt fails subsequent to a trigger signal being turned “ON”. Inanother embodiment, reader 10 is configured, on selection of a lineardecode mode to operate in a linear decode mode, and then automaticallyswitch to a normal decode mode of operation if there is no successfuldecoding of a symbol, a predetermined time subsequent to a triggersignal being turned “ON”. The predetermined time may be calculated basedon the frame rate. That is, the predetermined time may be considered tohave elapsed if after Y frames have been captured and subjected to adecode attempt, and decoding is still not successful. Trigger signalscan be caused to change state on the actuation of trigger 13 t. Triggersignals can also be caused to change state to an “ON” stateautomatically on the sensing of features in image data as explained inU.S. patent application Ser. No. 09/432,282, filed Nov. 2, 1999,entitled “Indicia Sensor System For Optical Reader,” incorporated byreference. Trigger signals can also be caused to change state to an “ON”state by communication from a nonintegrated processor system M asexplained in U.S. patent application Ser. No. 09/385,597, filed Aug. 30,1999, entitled, “Optical Reader System Comprising Local Host ProcessorAnd Optical Reader.”

An embodiment of the invention wherein control circuit 140 is configuredto operate in a picture taking mode and in a decode mode, is describedwith reference to FIGS. 6 a and 6 b. The inventors observed that it maybe desirable to differentiate between camera control parameters used forpicture taking and camera control parameters used for decoding. Forpicture taking, for example, the speed with which an image is taken isgenerally not an important consideration. Therefore, a long exposureperiod can be used with less artificial light. For decoding, speed ofimage capture is often critical. Users of optical readers demand thatthe readers they use decode decodable symbols quickly. Therefore,decoding is generally enhanced with use of substantial artificial lightand shorter exposure periods.

Referring to the flow diagram of FIG. 6 a, a mode selection of one apicture taking mode at block 2202 or decode mode at block 2204 causesbranching to one of blocks 2206, 2208, in which control circuit waitsfor a trigger signal to change to an “ON” state (trigger signals can becaused to switch to an “ON” state manually, manually remotely, orautomatically as described previously). At block 2210 control circuit140 loads a camera control parameter.

The “loading a camera control parameter” step as described herein can beaccomplished using any one of a number of known programming methods. Aprogram executed by control circuit 140 can have a “parameter table”storing a plurality of parameter values and the program may call one ormore parameters of the parameter table at a specific point of a programexecution. The loading of a camera control parameter step can beaccomplished by changing one or more values of a program's parametertable. The loading of a camera control parameter step can also beaccomplished by changing a destination of one or more program pointersor by any other known programming method for generating a command toredirect program flow.

The at least one camera control parameter loaded at block 2210 may takeon a variety of forms. The at least one camera control parameter may be(e.g., an exposure period value, a gain control value, an illuminationlevel value (controlling current to LEDs 16, 18), a frame rate, aninitial exposure period value, an initial gain value, an initialillumination level value (controlling current to LEDs 16, 18), or aninitial frame rate). In one particular example of the invention, aparameter loaded at block 2210 is a parameter which establishes a zeroillumination level generated by the aiming/illumination system of reader5 during the course of the picture taking mode (a parameter which whenread operates to cut off current to LEDs 16, 18). Photograph qualityunder certain circumstances may be enhanced when an image is capturedwith LEDs 16, 18 “OFF”.

A parameter loaded at block 2210 may also be a variable of a formulaused to adjust a characteristic of frame capture over the course ofseveral frames as in the exposure period development method described inU.S. patent application Ser. No. 09/766,922, filed Jan. 22, 2001,entitled “Optical Reader Having Reduced Parameter Determination Delay,”incorporated by reference. To illustrate an example of a formulavariable type parameter which could be loaded at block 2210, thevariable parameter could be a variable of the formula used to adjustcharacteristics of image capture over the course of several frames. In aspecific example, a next frame's (Frame N) exposure period could becalculated based on a relationship between a target frame white value(which may be calculated using a sample pixel white value data), anobserved frame white value, a previous frame's (Frame N-M, M□1) exposureperiod and a variable, wherein the value of the variable depends onwhether the picture taking mode or the decode mode is selected. Thecamera control parameter which is loaded at block 2210 may also comprisea series of instructions. For example, control circuit 140 at block 2210may alter a program pointer or set up an appropriate call or othersuitable command so that a dynamically linked library file (as .dll,.ocx or equivalent kinds of files) particular to the picture taking modeis installed. At block 2210, control circuit 140 may install a firstdynamically linked library (DLL) file for execution of first algorithmfor controlling (e.g., gain or exposure or illumination). At block 2230(executed during the decode mode) control circuit 140 may install asecond DLL for execution of a second algorithm for controlling (e.g.,gain, exposure, illumination level), wherein the second algorithmincludes a set of instructions different than the set of instructions ofthe first algorithm.

At block 2214, control circuit 140 captures a frame of image datautilizing the at least one camera control parameter loaded at block2210. For example, if the at least one parameter loaded at block 2210 isthe single parameter of a specific exposure period, control circuit 140at block 2214 captures a frame of image data into RAM 142 utilizing thespecific exposure period setting loaded at block 2210. It will beunderstood that capture block 2214 may actually include the capture ofone or more “parameter determination” frames of image data which arecaptured for purposes of developing a frame of image data intended foroutput at block 2220.

Referring again to the flow diagram of FIG. 6 a, control circuit 140 atblock 2220 outputs a frame of image data captured at block 2214.Outputting a frame of image data at block 220 may be accomplished in avariety of useful ways. Control circuit 140 may display the capturedimage on display 13 d, may send the image to a host 200 or network 1810(FIG. 7), or may send the image to a printer for printing.

If the decode mode is selected at block 2204, control circuit 140proceeds to block 2208 to wait for a trigger signal to change to an “ON”state as described previously. On the changing of a trigger signal to an“ON” state at block 2208, control circuit 140 loads at least one decodemode camera control parameter in the manner of the loading of thepicture taking camera control parameters as described relative to block2230. At block 2234, control circuit 140 captures a frame of image datainto RAM 142 utilizing the at least one camera control parameter loadedat block 2230. As explained with reference to capture block 2214, thecapture block 2234 may actually involve a series of frame capture stepsincluding capturing of “parameter determination” frames of image data.At block 2238, control circuit 140 decodes a decodable symbol. Asexplained in U.S. Pat. No. 5,929,418, issued Jul. 27, 1999, entitled,“Optical Reader Having Improved Menuing Features,” it is understood thatthe capture and decode steps 2234 and 2238 may comprise a series offrame captures and failed decode attempts until a decodable symbolrepresented in a captured frame of image data is successfully decoded.The decode algorithm launched at block 2238 may be a bar code decodingalgorithm. Aspects of decoding algorithms for decoding various types ofsymbols are known and are publicly available. AIM, Inc., the Associationfor Automatic Identification and Data Capture Technologies, publishesbar code symbology standards and notices. Various bar code standards areavailable from the AIM, Inc. website, www.aimglobal.org. The symboldecoded at block 2238 in addition to being a bar code may be (e.g., adecodable character such as an OCR character or a fingerprint) Furtheraspects of decodable symbol decoding are described in the previouslyreferenced U.S. patent application Ser. No. 09/904,697.

At block 2242, control circuit 140 outputs a decoded out message,typically in the form of a character string in the case the decodedsymbol decoded at block 2238 is a bar code symbol. The outputting of thedecoded out message may be accomplished by displaying a decoded outmessage on a display 13 d and/or sending a decoded out message to adevice (e.g., a host computer 200 or network 1810) external from reader10.

An example of image capture block 2214 in which at least one “parameterdetermination” frame of image data is captured for parameterdetermination prior to a frame being captured for output is describedwith reference to the flow diagram of FIG. 6 d.

At block 2304, control circuit 140 captures a frame of image datautilizing a present exposure period value. If the frame captured atblock 2304 is the first frame captured after reader 10 is driven into apicture taking mode, then the exposure period value may be an initialexposure period value loaded at block 2210 and selected to yield animage of high visual quality (another picture taking mode imaging inputsuch as gain or illumination level could also or in the alternative beapplied at block 2304). At block 2306, control circuit 140 determines ifthe last captured frame is to be output. For example, reader 10 can beset up so that a second, third or Nth frame is output after the previousframes are processed for parameter determination. In certain imagingsystems, a parameter derived by analysis of captured image data is notavailable for input until after a plurality of frames have beencaptured. At block 2310, control circuit 140 builds a histogramsummarizing the image data of the frame. A captured frame of image datatypically comprises a plurality of gray scale pixel values. Generally asample of pixel values are sampled from a full frame for purposes ofgenerating a histogram. Alternatively, a partial frame of image data canbe captured as described in co-pending application Ser. Nos. 09/766,806,filed Jan. 22, 2001, entitled “Optical Reader Having Partial FrameOperating Mode” and 09/766,922, filed Jan. 22, 2001, entitled “OpticalReader Having Reduced Parameter Termination Delay,” incorporated byreference. A histogram corresponding to a picture of a typical visualimage (that is, not a typical decodable symbol) may take to form ofpicture taking mode histogram 2502 of FIG. 6 f. Histogram 2502, ifcorresponding to a typical visual display image, may comprisesubstantially an even count of pixels at each gray scale value (0-255 inan 8 bit gray scale) throughout the range of possible gray scale values.

At block 2316, control circuit 140 evaluates picture taking modehistogram 2502 according to a picture taking mode histogram evaluationcriteria. The inventors found that captured images have a high visualobservation quality if image capturing inputs (exposure period, gain,illumination level) are controlled so that a median gray scale value ofan image is at about a predetermined gray scale value, preferably a grayscale value in the middle (e.g., a gray scale value from about 55 toabout 200) of the gray scale. In the specific example of FIG. 6 f,histogram 2502 is evaluated to determine whether the median gray scalevalue of histogram is above or below the predetermined middle range grayscale value of 150. In other words, the median gray scale value of thehistogram 2502 is set to a set point. In order to achieve the set point,imaging inputs are controlled in accordance with the evaluation of thehistogram evaluation block 2316. If the captured image is too dark (ifthe median gray scale value of histogram 2502 is less than 150), controlcircuit 140 at block 2320 increases an exposure period value. If thecaptured image is too light, control circuit 2322 at block 2322decreases an exposure period value to lighten a subsequent image. Theexposure period adjustment steps at block 2320, 2322 could besubstituted for by another suitable image capturing input (e.g., gain,control, or illumination level control).

In the flow diagram of FIG. 6 e, an example of decode mode image captureblock 2334 having a plurality of image capturing steps includingparameter determination steps is described. The steps 2404, 2406, 2410,2416, 2418, 2420, and 2422 of decode mode image capturing block 2234 ofFIG. 6 e are the same as the steps 2304, 2306, 2310, 2316, 2318, 2320,and 2322 described with reference to the flow diagram of FIG. 6 d exceptfor two points of distinction: first, the initial (E₀) decode modeexposure value period (or other initial imaging input) applied at thefirst execution of block 2404 is a value different than the initial (E₀)picture taking mode exposure period value applied at block 2304. Ingeneral, an initial exposure period in a picture taking mode is selectedto be longer than an initial exposure period in a decode mode. Theinventors found that for high quality visual display (display whereinrepresented objects can readily be discerned by the human eye), lighterimages are preferred and that for decoding, darker and faster capturedimages can be utilized.

The second difference respecting the decode mode capture block 2234 asdepicted in FIG. 6 e and the picture taking mode image capture block2214 as depicted in FIG. 6 d is in relation to the application ofhistogram evaluation criteria (block 2416 as compared to block 2316). Ina decode mode histogram evaluation block 2416 a different histogramevaluation criteria is applied than the criteria applied at picturetaking mode histogram evaluation block 2316. A representation ofhistogram 2602 corresponding to an image of a black decodable symbol ona white substrate is shown on FIG. 6 g. Histogram 2602 represents whatmay be considered a bi-tonal image. Histogram 2602 includes a highnumber of gray scale values at a dark pixel range, as indicated by darkpeak 2610 and a high number of gray scale values at a light pixel rangeas is indicated by light peak 2620.

The inventors found that captured images are quickly obtained andreadily decoded if image capturing inputs (exposure period, gain,illumination level) are controlled so that a predetermined near peakgray scale value of a histogram corresponding to an image is at about apredetermined gray scale value, preferably a gray scale value in themiddle (e.g., a gray scale value from about 55 to about 200) of the grayscale. In the specific example of FIGS. 6 e and 6 f, histogram 2602 isevaluated to determine whether a predetermined 97% peak gray scale valueof histogram 2602 (the gray scale value at which 3% of gray scale valuesare above and 97% below) is above or below the predetermined middlerange gray scale value of 150. In other words, a predetermined near peakgray scale value of the histogram is set to a set point. In order toachieve the set point, imaging inputs are controlled in accordance withthe evaluation at the histogram evaluation block 2416. If the capturedimage is too dark (if the 97% gray scale value of histogram 2602 is lessthan 150), control circuit 140 at block 2420 increases an exposureperiod value to brighten the image. If the captured image is too light,control circuit 140 at block 2422 decreases an exposure period value.The exposure period adjustment steps at blocks 2420, 2422 could besubstituted for by another suitable image capturing input (e.g., gain,control, or illumination level control). The use of a near peak value(e.g., 97%) at histogram evaluation block 2416 as opposed to a peakvalue (the highest gray scale value of the histogram) minimizes theimpact that spuriously high light values (as might be caused by specularreflections) might otherwise have on the imaging input control system.

Referring now to the flow diagram of FIG. 6 b an alternative embodimentof the invention is described. In the embodiment of FIG. 6 b, controlcircuit 140 is operable as described in FIG. 6 a except that controlcircuit 140 further includes an automatic imaging mode as indicated byblock 2200. In an automatic imaging mode as described in previouslyreferenced U.S. patent application Ser. No. 09/904,697, filed Jul. 13,2001, entitled, “Optical Reader Having A Color Imager,” an image iscaptured at block 2254 and subjected to classification by aclassification circuit at block 2258. At block 2258, the image can beclassified on the basis of whether the image includes a graphical symbolsuch as bar codes, text, or OCR characters. High energy, (e.g.,black-white transitions are a good indicator for the presence of agraphical symbol, such as a bar code symbol). Where image sensor 32 is acolor image sensor, a black and white bi-tonal image will consist ofgreen pixels that are in one of two possible value ranges. One narrowrange of values is representative of white portions of the image,whereas the other narrow range of values is representative of blackportions of the image. Where image sensor 32 is a monochrome imagesensor, a black and white bi-tonal image will consist of pixel valuesthat are within one of two ranges at the extremes of the gray scale.Further aspects of graphical symbol detection are described in greaterdetail in the previously referenced U.S. patent application Ser. No.09/904,697, filed Jul. 13, 2001, entitled, “Optical Reader Having AColor Imager.” In determining whether a captured frame of image includesa bitonal graphical symbol, control circuit 140 may evaluate whether aframe of image data includes pixel values in two distinguishable rangesof pixel values.

At block 2262, control circuit 140 processes the image captured at block2254 in a manner that depends on the classification of the image atblock 2258. For example, if at block 2258, control circuit 140determines that the captured image does not include a graphical symbol,then control circuit 140 may, without attempting to decode decodablesymbol, output the image in the manner described with reference to block2220. If control circuit 140 at block 2258 determines that the imagedoes in fact include a graphical symbol, control circuit 140 at block2262 may attempt to decode a decodable symbol therein and output adecoded out message (e.g., display the message on a display or sent itto host 200 or network 1810).

If at block 2262, control circuit 140 determined that an image does notinclude a graphical symbol, control circuit 140 may in the alternativeautomatically jump to block 2210 to load at least one “picture takingmode” camera control parameter, and then automatically execute blocks2214 and block 2220 as described previously to capture a subsequentframe of image data and to output the captured frame captioned at block2214. If at block 2262, control circuit 140 determines that an imagedoes, in fact, include a graphical symbol, control circuit 140 mayautomatically jump to block 2230 to load at least one decode mode cameracontrol parameter as described previously and then automatically jump toblock 2234 and then to block 2242 to decode a decodable symbol (block2238) and then output a decoded output message corresponding to thesymbol (block 2242).

Control circuit 140 may be driven into one of the picture taking, decodemode or automatic imaging modes by way of a user entering a command withuse of one of an available menu interface, as described previously withreference to selection of the linear decode mode. The picture taking,decode, and automatic imaging modes may be selected (e.g., with use of alocal or remote graphical user interface, with use of menu symbols, orby actuation of an appropriate key or a local or remote keyboard). Withreference to FIG. 3 e, a picture taking mode can be selected byactuation of icon 1702, a decode mode can be selected by actuation ofdecode mode icon 1701, 1703 an automatic imaging mode can be selected byactuation of icon 1704. Further, as will be described, “photographimprovement” mode of operation, which can be selected by actuation oficon 1705, or with use of another suitable menu interface (e.g., remoteGUI, local or remote keyboard key, menu symbol) describer herein.

In another aspect of the invention, control circuit 140 may operate in a“photograph improvement” mode of operation. In a photograph improvementmode, control circuit 140 improves a visual output quality (display orprint) of a last captured image captured by control circuit 140. A lastcaptured image is typically stored in a last frame buffer memorylocation 144 of RAM 142. Further as part of a photograph improvementmode of operation, control circuit 140 may output a frame of image datathat has been subjected to improvement. In another embodiment of aphotograph improvement mode, control circuit 140 improves a visualoutput quality of a currently displayed image displayed on display.

Decode mode camera control parameters, which may be loaded at block2230, when utilized by control circuit 140 during image capture oftenresult in the capture of an image which is of high quality for decodingpurposes but of poor quality for visual display purposes. Further, incommon embodiments, imaging lens assembly 40 often includes fixed shortrange optics which optimizes reader for short range symbol reading butdo not optimize the reader for picture taking. Accordingly, it is highlyuseful to manually drive reader 10 into an improvement mode after thereader has captured an image in accordance with a decode mode ofoperation. It is also often useful to drive reader 10 into animprovement mode of operation after the reader has captured an imageduring the course of operating in a picture taking mode of operation,especially given that, as mentioned, reader 10 is often not optimizedfor long range (e.g., several feet) picture taking.

The reader 10 may be driven into an improvement mode by user selectionvia a menu interface of the type described previously (e.g., manualreader keyboard 13 k, manual reader GUI displayed on display 13 d,remote (host) GUI, remote keyboard, menu symbol. Reader 10 may also bedriven into an improvement mode automatically. For example, theimprovement mode may be executed automatically as part of the picturetaking mode described previously with reference to the flow of diagramsof FIGS. 6 a and 6 b. That is, output block 2220 may be replaced byexecution of an improvement mode in which control circuit 140 improves avisual output quality of an image prior to outputting the image.

Control circuit 140 may improve a visual output quality of an image in anumber of different ways. For example, in the case of a monochromeimage, control circuit 140 may improve a visual output quality of animage by reducing the contrast of the image (e.g., by reducing eachlight pixel value by predetermined or dynamical scale levels). Whenoperating in a decode mode, control circuit 140 in a typical embodimentattempts to capture an image having high contrast (e.g., dark areas arerepresented at the low end of the gray scale and light areas arerepresented at the high end of the gray scale). However, a high contrastimage is often not preferred for visual output purposes. Accordingly, avisual output quality of a captured frame subjected to decoding canoften be improved by reducing a gray scale value of pixel values of theimage that are at the high end of the gray scale and by increasing agray scale value of pixel values at the lower end of the gray scale.

In a “save” mode of operation, selectable by actuation of icon 1706,control circuit 140 saves a last captured image to a frame storagelocation. RAM 142 and/or another memory device such as flash memory 120may have defined therein M number of frame storage locations. The framestored within buffer 144 may be copied or transferred into one of the Mframe storage locations each time the save button 1706 is activated.

In a “preview mode” selectable by actuation of icon 170, one or moreframes stored in the M frame storage locations are displayed forobservation. Display 13 d can display one or more previously capturedand stored frames at a given time. If a displayed frame displayed duringa preview mode is of poor visual quality, a user may select a photographimprovement mode by actuation of icon 1705 to improve the visual outputquality of the frame. When an erase mode is selected by actuation oficon 1708, the display image is removed from a memory 142,120. When a“send mode” is selected by actuation of icon 1709, the presentlydisplayed frame is sent to a remote device (e.g., host 200, network1810).

By selection of icon 1710, or by input into another suitable menuinterface as described herein, reader operates in a “movie mode”. A“movie mode” of operation is described with reference to the flowdiagram of FIG. 6 c. When a movie mode is selected at block 227, controlcircuit 140 proceeds to block 2272 to load a movie mode camera controlparameter, which may be (e.g., and exposure period, a gain, anillumination level, a frame rate, an initial exposure period, an initialgain, an initial illumination level, an initial frame rate, a variablein a formula or a set of instructions). A “movie mode camera controlparameter” as described herein is one which, when processed by controlcircuit 140 results in an image being captured that is optimized forvisual display quality when the frame is one frame out of a series ofcontinuously displayed frames. At block 2276, control circuit 140captures an image utilizing at least one movie mode camera controlparameter loaded at block 2272. At block 2280, control circuit 140outputs the frame captured at block 2276, typically by displaying theimage on display 13 d of reader 10. If control circuit 140 determines atblock 2284 that the movie mode is still active, control circuit 140reverts to block 2276 to capture another frame of image data utilizingthe at least one movie mode camera control parameter, and then again toblock 228 to display the captured image. The process of capturing anddisplaying images continues until the movie mode is deactivated. Thecontinuous capture and display of new images on display results in amotion picture or “movie” being displayed on display 13 d. The series ofcontinuous images displayed on display 13 d during a movie mode may bereferred to a streaming video image.

In the specific embodiment of FIG. 6 c, the capturing of frames of imagedata commences automatically after operation in the movie mode isselected (i.e., automatically after icon 1710 is actuated) without therefirst being a change of state of a trigger signal. Control circuit 140can be configured so that a movie mode is deactivated when a triggersignal is turned “ON.” For example, control signal 140 can be configuredso that when a first trigger button 13 t-1 (FIG. 1 e) is actuated,control circuit 140 automatically jumps to block 2230 from decisionblock 2284 to automatically load a decode mode parameter, capture animage utilizing the decode mode parameter, and decode a decodable symbolrepresented the captured frame. Control circuit 140 can also beconfigured so that when second trigger button 13 t-2 (FIG. 1 e) isactuated, control circuit 140 automatically jumps from decision block2284 to block 2210 to automatically load a picture taking mode cameracontrol parameter and to block 2214 and 2220 to capture and output aframe of image data utilizing the camera control parameter. It is seenthat actuation of a movie mode enables locating of a target decodablesymbol or area to be subjected to image capture. When the movie mode isactuated, a frame of image data substantially corresponding to thepresent field of view of reader 10 will be displayed. By actuation ofthe movie mode a user can manipulate reader 10 into such location that arepresentation of the area intended to be the subject of a decodeattempt or a picture taking is displayed on display 13 d.

In another aspect of the invention, control circuit 140 may display ondisplay 14 d a filter option menu screen as indicated by FIG. 3 f.Control circuit 140 may be caused to display the filter option screenmenu screen of FIG. 3 f by selection of filter options icon 1712 of themenu screen of FIG. 3 e. Alternatively, filter selection icons 1804,1806 and 1806 could be displayed on the menu option screen of FIG. 3 e.The filter option menu screen of FIG. 3 e presents a user with variousoptions for processing an image to be captured. When gamma correctionicon 1804 is selected, a next captured image captured by reader 10(whether captured in a decode mode or in a picture taking mode) issubject to gamma correction. When flatting icon 1806 is selected, a nextcaptured image captured by reader 10 is subject to image flattening (forcorrection of distortion owing to the cosine effect). When edgeenhancement icon 1808 is selected, a next captured image captured byreader 10 is subject to edge enhancement.

As embodied herein and depicted in FIG. 7, an example of an opticalreader network 1800 in accordance with the present invention isdisclosed. Network 1800 includes wireless system 1400, personal computer1802, optical reader 10, LAN 1820, network servicing center 1830, andpersonal area network (PAN) coupled together via network 1810.

One of ordinary skill in the art will recognize that network 1810 may beof any suitable type depending on the application, but there is shown byway of example the Internet. However, the present invention should notbe construed as being limited to this example. In another embodiment,network 1810 is a private network. Those of ordinary skill in the artwill also recognize that network 1810 is a wire line network in oneembodiment, and a wireless network in another embodiment. Network 1810may include circuit switched networks, IP networks, or both.

LAN 1820 includes server 1822, computer 1824, database 1826, and aplurality of optical readers 10. Database 1826 is used to storeassociated images along with other data fields. One may want toassociate the delivery means, route, driver, and other relatedinformation for subsequent analysis. Network 1810 allows reader 10, PAN1850, and wireless system 1400 a way to store such data in database1826. System analysts can access this information via personal computer1802 connected to network 1810. In one embodiment, LAN 1820 includes anInternet website. In this embodiment, users are authenticated beforegaining access to database 1826.

Network servicing center 1830 is coupled to network 1810 via interface1844. Center 1830 also includes server 1832, computer 1834, database1836, signature verification module 1838, authentication module 1840,coupled together via a LAN. Center 1830 accommodates any number ofuseful applications programs 1842.

PAN 1850 includes at least one color optical reader 10 coupled topoint-of-sale (POS) terminal 1854. POS terminal 1854 is coupled tonetwork 1810 via interface 182. POS terminal 1854 includes a credit cardreader and a signature capture block. In the scenario depicted in FIG.7, a merchant user of POS terminal 1854 transmits an associated customercredit card number, signature, and in one embodiment, a color image ofthe customer, to center 1830. Authentication module 1840 is used toauthenticate the credit card and signature verification module is usedto authenticate the signature. In another embodiment, database 1836 isused to store the customer's image, credit card number, and signaturefor verification purposes.

According to its major aspects and broadly stated, the invention is apicture taking bar code reader. As explained in copending applicationSer. No. 10/143,158, filed May 10, 2002, incorporated by reference, itis useful to use an imaging based optical reader to take pictures (e.g.,of a package including a bar code).

In one aspect, the invention includes an optical reader having a decodemode of operation and a picture taking mode of operation. In the decodemode of operation, a control circuit of the reader loads at least onedecode mode camera control parameter, captures a frame of image datautilizing said at least one decode mode camera control parameter,decodes a decodable symbol representation in said captured frame ofimage data, and outputs a decoded-out message. In the picture takingmode of operation, a control circuit loads at least one picture takingcamera control parameter, captures a frame of image data utilizing thepicture taking camera control parameter, and without attempting todecode decodable symbol in said frame, outputs said frame of capturedimage data.

According to the invention, a “decode mode” camera control parameter isone which is established for the purpose of aiding in the capture of aframe of image data which is optimized to be subjected to decoding. A“picture taking mode” camera control parameter, as refereed to herein,is one which is established for the purpose of aiding in the capture ofa frame of image data which is optimized for visual output quality.

In another aspect, the invention includes an optical reader having adecode mode of operation and an automatic imaging mode of operation. Inthe decode mode of operation, a control circuit of the reader loads adecode mode operational parameter, captures a frame of image datautilizing the parameter, decodes a decodable symbol representation inthe captured frame of image data, and outputs a decoded-out message. Inthe automatic imaging mode of operation, the control circuit of thereader captures a frame of image data, and evaluates the image data todetermine whether the image data includes a graphical symbol. The readermay then process the image data in a manner that depends on the resultof the image evaluation.

In another aspect, the invention includes an imaging device having apicture taking mode of operation and an automatic imaging mode ofoperation. In the picture taking mode, a control circuit of the deviceloads a picture taking mode operational parameter, captures a frame ofimage data utilizing the parameter, and without attempting to decode adecodable symbol representation therein, outputs the captured frame ofimage data. In the automatic imaging mode of operation, the controlcircuit of the reader captures a frame of image data, and evaluates theimage data to determine whether the image data includes a graphicalsymbol. The reader may then process the image data in a manner thatdepends on the result of the image evaluation.

In another aspect, the invention includes an optical reader having apicture taking mode of operation, a decode mode of operation, and animprovement mode of operation. In an improvement mode of operation, thecontrol circuit of the reader improves the visual display or print(visual output) quality of the last captured frame of image datacaptured by the optical reader.

These and other details, advantages and benefits of the presentinvention will become apparent from the detailed description of thepreferred embodiment and the associated drawings.

There is set forth herein:

A1. A bar code decoding device comprising:

a portable housing;

a lens assembly focusing an image onto said two dimensional imagesensor;

a control circuit in communication with said illumination assembly andsaid imaging assembly, wherein said control circuit is configured tooperate in a “decode mode” and a “picture taking mode”; and

a user interface facilitating selection between said decode mode andsaid picture taking mode;

wherein said control circuit, when operating in said “decode mode” loadsa “decode mode” initial exposure period value, captures a frame of imagedata utilizing said “decode mode” initial exposure period value, buildsa histogram summarizing said captured frame, evaluates said histogramaccording to a “decode mode” histogram evaluation, and adjusts saidinitial exposure period value depending on an outcome of saidevaluation;

wherein said control circuit, when operating in said “picture taking”mode loads a “picture taking mode” initial exposure period value,captures a frame of image data utilizing said initial “picture takingmode” initial exposure period value, builds a histogram summarizing saidcaptured frame, evaluates said histogram according to a “picture takingmode” histogram evaluation criteria, and adjusts said initial exposureperiod value depending on an outcome of said evaluation,

wherein said “decode mode” initial exposure period value is less thansaid “picture taking mode” initial exposure period value.

A2. The optical reader of A1, further comprising artificial lightsources projecting light from said reader, wherein said at least onecamera control parameter is one which maintains all of said artificiallight sources “OFF” during a “picture taking mode” of operation.A3. The optical reader of A1, wherein said reader includes a display andwherein said user interface includes icons displayed on said display.A4. The optical reader of A1, wherein said control circuit is furtherconfigured to operate in an improvement mode in which said controlcircuit improves a visual output quality of a last captured imagecaptured by said reader independent of whether said last captured imagewas captured in a “decode mode” or in a “picture taking mode.”A5. The optical reader of A1, wherein said portable housing houses saidillumination assembly, and wherein said portable housing is configuredto be worn on a finger.A6. The optical reader of A1, wherein said control circuit in accordancewith said “decode mode” histogram evaluation criteria determines whethera predetermined near-peak gray scale value of said histogram is above orbelow a middle range gray scale value.A7. The optical reader of A1, wherein said control circuit in accordancewith said “picture taking mode” histogram evaluation criteria determineswhether a median gray scale value of said histogram is above or below amiddle range gray scale value.A8. The optical reader of A1, wherein said control circuit in accordancewith said “decode mode” histogram evaluation criteria determines whethera predetermined near peak gray scale value of said histogram is above orbelow a middle range gray scale value, and wherein said control circuitin accordance with said “picture taking mode” histogram evaluationcriteria determines whether a median gray scale value of said histogramis above or below a middle range gray scale value.B1. A bar code reader comprising:

an image sensor;

a control circuit in communication with said image sensor andcontrolling said image sensor to include overlapping frame exposureperiods;

at least one illumination light sources projecting an illuminationpattern;

at least one aiming light source projecting an aiming pattern onto atarget substrate,

wherein said control circuit in at least one operating mode coordinatescontrol of said at least one aiming light source so that said at leastone light source is selectively turned “OFF” while pixels of said imagesensor corresponding to said aiming pattern are being exposed.

B2. The bar code reader of B1, wherein said image sensor is CMOS imagesensor.B3. The bar reader of B1, wherein said aiming pattern is singlehorizontal line aiming pattern.B4. The bar code reader of B1, wherein said control circuit is operablein a user-selectable “linear decode mode” and a user selectable “normaloperating mode,” wherein said control circuit in said “linear decodemode” maintains said at least one illumination light source “OFF” andsaid at least one aiming light source selectively “ON” while pixelscorresponding to said aiming pattern are being exposed, and wherein saidcontrol circuit in said “normal operating mode” selectively turns saidat least one aiming LED “OFF” while pixels of said image sensorcorresponding to said aiming pattern are being exposed.C1. An optical reader comprising:

a two-dimensional image sensor including pixels;

a lens assembly;

an aiming and illumination system comprising at least one aiming lightsource and at least one illumination light source, wherein said readeris configured so that actuation of said at least on aiming light sourceprojects an aiming pattern, and further so that actuation of said atleast one illumination light source projects an illumination pattern,wherein said aiming pattern and said illumination pattern at leastpartially overlap;

a control circuit in communication with said two dimensional imagesensor and said illumination system, said control circuit configured tooperate in linear decode mode in which, during a frame exposure period,said aiming and illumination system projects said aiming pattern withoutprojecting said illumination pattern.

C2. The optical reader of C1, wherein said aiming pattern consist of ahorizontal aiming line.C3. The optical reader of C1, wherein said aiming an illumination systemand said control circuit are configured so that said control circuitpreferentially processes image data corresponding to an area illuminatedby said horizontal aiming line.C4. The optical reader of C3, wherein said control circuit inpreferentially processing image data clocks out and captures a partialframe of image data corresponding to said area illuminated by saidhorizontal aiming line.C5. The optical reader of C3, wherein said control circuit inpreferentially processing image data launches a scan line relative topixel values representing said area illuminated by said horizontalaiming line.C6. The optical reader of C1, wherein said lens assembly is configuredso that said reader has a fixed best focus distance of less than twofeet.C7. The optical reader of C1, wherein said reader is configured to bedriven into said linear decode mode on receipt of a command from a hostcomputer.C8. The optical reader of C1, wherein said reader is configured toautomatically cease operating in said linear decode mode if said controlcircuit fails to decode a symbol while operating in said linear decodemode.D1. An optical reader comprising:

a two-dimensional image sensor comprising a plurality of pixels;

an imaging assembly;

an aiming and illumination system comprising at least one aiming lightsource and at least one illumination light source, wherein said readeris configured so that actuation of said at least one aiming light sourceprojects an aiming pattern, and further so that actuation of said atleast one illumination light projects an illumination pattern;

a control circuit configured to operate in a first decode mode and asecond decode mode, wherein said control circuit in said first decodemode simultaneously projects said aiming pattern and said illuminationpattern during a frame exposure period so that said imaging assemblysenses light from both of said at least one aiming light source and saidillumination light source during said frame exposure period.

D2. The optical reader of D1, wherein said aiming pattern consists of ahorizontal aiming line.D3. The optical reader of D1, wherein said aiming an illumination systemand said control circuit are configured so that said control circuitpreferentially processes image data corresponding to an area illuminatedby said horizontal aiming line.D4. The optical reader of D3, wherein said control circuit inpreferentially processing image data clocks out and captures a partialframe of image data corresponding to said area illuminated by saidhorizontal aiming line.D5. The optical reader of D3, wherein said control circuit inpreferentially processing image data launches a scan line relative topixel values representing said area illuminated by said horizontalaiming line.D6. The optical reader of D3, wherein said reader is configured toautomatically cease operating in said linear decode mode if said controlcircuit fails to decode a symbol while operating in said linear decodemode.D7. The optical reader of D1, wherein said control circuit during saidnormal decode mode selectively projects said aiming pattern intermediateframe exposure periods and selectively projects said illuminationpattern during frame exposure periods.E1. An optical reader comprising:

a portable housing;

an illumination assembly;

an imaging assembly;

a control circuit;

a user interface enabling selection between modes of operation;

a picture taking mode executable by said control circuit in which saidreader captures a frame of image data and without attempting to decodedecodable symbol therein outputs said capture frame of image data;

a decode mode executable by said control circuit in which said controlcircuit captures a frame of image data and decodes a decodable symbolrepresented therein;

a picture improvement mode in which said optical reader improves avisual output quality of a last captured frame, wherein said reader isconfigured to be driven into said picture improvement mode irrespectiveof the mode of operation of the reader in during a most recent framecapture period.

E2. The reader of E1, wherein said user interface includes displayedmenu options.E3. The reader of E1, wherein said imaging assembly is configured sothat said reader has a fixed best focus distance of less than two feet.E4. The reader of E1, wherein said menu interface includes menu symbols.E5. The reader of E1, wherein said menu interface facilitates selectionof said picture taking mode, said decode mode and said improvement modeby input of a command into a remote device nonintegrated relative tosaid portable housing.E6. The reader of E1, wherein said control circuit in said pictureimprovement mode decreases a value of light pixel values and increases avalue of dark pixel values.

While the present invention has been particularly shown and describedwith reference to the preferred mode as illustrated in the drawing, itwill be understood by one skilled in the art that various changes indetail may be effected therein without departing from the spirit andscope of the invention as defined by the claims.

1. A portable apparatus comprising: a portable housing; a userinterface; a two dimensional image sensor including pixels; a lensassembly focusing an image onto said two dimensional image sensor;wherein the apparatus is operative for capture of a frame of image dataresponsively to an actuation of an actuator; wherein the apparatus isfurther operative for subjecting the frame of image data to decoding todetermine a decoded message; wherein the apparatus is further operativefor output of the decoded message; wherein the apparatus is furtheroperative for, subsequent to the decoding, improving a visual outputquality of the frame of image data; wherein the apparatus is furtheroperative for outputting the frame of image data subsequent to it beingsubject to visual output quality improvement.
 2. The portable apparatusof claim 1, wherein the apparatus is operative to perform visual qualityimprovement on the frame of image data responsively to an operatorentered command entered using the user interface.
 3. The portableapparatus of claim 1, wherein the apparatus is operative to performvisual quality improvement on the frame of image data by increasing avalue of dark pixels.
 4. The portable apparatus of claim 1, wherein theapparatus is operative to perform visual quality improvement on theframe of image data by decreasing a value of light pixel values.
 5. Theportable apparatus of claim 1, wherein the apparatus is operative toperform visual quality improvement on the frame of image data byincreasing a value of dark pixel values and decreasing a value of lightpixel values.
 6. The portable apparatus of claim 1, wherein the userinterface is a graphical user interface.
 7. The portable apparatus ofclaim 1, wherein the user interface includes menu symbols.
 8. Theportable apparatus of claim 1, wherein the apparatus includes a display.9. The portable apparatus of claim 1, wherein the apparatus includes atouch screen display.
 10. The portable apparatus of claim 1, wherein thelens assembly is a fixed range lens assembly.
 11. The portable apparatusof claim 1, wherein the apparatus has a fixed best focus distance ofless than two feet.